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VISUALLY ERROR-FREE COLOR IMAGE REPRESENTATION 



Technical Field 

The present invention relates to colorspace interchange and more particularly, to 
providing substantially visually error-free color data interchange for a plurality of electronic 
devices. 

Background of the Invention 

Communication of color information between different devices and industries has 
become recognized as an important issue. Each industry generally has its own color 
management history, with its own terminology standards and methods for communicating color 
information. As more users are connecting different peripheral devices made by different 
companies and, in addition, communicate with one another over the Internet, it is becoming more 
urgent to have a standardized color data management scheme that provides consistent color data 
management. Many different practices and standards are currently being used. 

Different phosphor sets are being used to provide the colors of "red", "green", and 
"blue". For example, where a monitor may illustrate a pink color, and the user selects the pink 
color, the printer printing the selection may print out an ugly purple/lavender. Thus, different 
values on chromaticity diagrams represent a same color, providing confusion. Tone reproduction 
of various systems also differ. Also, viewing conditions may vary, causing colors to appear 
different to different observers. Thus, due to differing visual conditions, the color of the 



illuminant (the white point), the absolute level of the scene irradiance (generally the 
illuminance), the surrounding colors, etc., all affect the color perception unless the initial and 
final conditions are identical. Unless a white point and illuminance level are the same, the color 
interchange data may not be identical. 

Previous color data conversion methods have required the use of cube root computation 
or raising values to the third power. To store data, every pixel had to be converted using a set of 
power function routines. This process is time-consuming, consumes processing power, and may 
introduce errors. Other techniques, such as is described in U.S. Patent No. 5,224,178, by Madden 
et al., provide for compressing digital code values to provide a set of reduced range digital codes 
of a same resolution, but having a smaller range of basic image content values than the dynamic 
range of the digitized image data base. 

As shown in Figure 1 the chromaticity diagram has been developed by the Commission 
Internationale de PEclairage (CIE), or International Commission on Illumination, to provide a 
common chromaticity value for colors. The displayable colors by a laser device are shown as a 
triangle ABC, with points A 102, B 104, and C 106. Ideally, color values for a device should 
cover a triangle having an area that extends over the entire visible range. However, as shown in 
Figure 2, the triangle covered for color values of a Canon CLC500 color copier/printer 202 is 
shown along with the old RGB color values (Genl. RGB) 204, the first PC color monitors and 
the sRGB values 206. While some of the cyan colors are limited by sRGB, the brightest greens 
and reds are output device limited, but not sRGB limited. Clearly, calculations must be used to 
convert values of the color copier/printer 202 colors to the ordinary CRT colors (sRGB values) 
206. 



Although lasers have virtually monochromatic output and the primaries of the laser 
would reside on the spectrum locus of the CIE (International Commission on Illumination) 
diagram of Figure 1, showing 2 degree observer data, typically devices do not have the gamut to 
display the laser colorspace. Thus, data in a laser display colorspace would have to be converted 
for display and printing. 

Cathode display tubes (CRTs) , color flat panels (both active and passive matrix types) 
and high definition televisions (HDTVs) provide chromaticity diagrams that are similar to the 
CRT model shown in Figure 2. However, the sRGB chromaticity diagram lacks a range of 
gamut that includes all colors, and conversion of sRGB color data values is non-linear, thus often 
resulting in undesired results. 

Thus, color management technology is needed to facilitate color data interchange in the 
marketplace so that color devices may conveniently exchange color data in a common format 
without the need to translate constantly between color spaces because of different data 
representations in various devices. 

Summary of the Invention 

The present invention provides complete color representation for substantially the entire 
visual gamut and represents all colors substantially without visual error. That is, representation 
of substantially all visible colors typically perceived by the human eye is defined herein as 
representation of the colors ''without visual error"or "visually error free", including representing 
visually perceptible data values. 

The present invention provides an apparatus, method and computer-readable medium for 
converting digital signals for a color image into high quality error-free expanded colorspace 
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color images. A normalized RGB colorspace is defined for color values from 0 to 1. An 
expanded RGB/RGBA or expanded sRGB/sRGBA colorspace is defined herein to include color 
values below 0 and/or greater than 1. By extending the colorspace, the present invention 
eliminates the need for users to "clamp" color information into the predetermined range than are 
5 needed to fully describe the color. For example, where color data information is limited to an-8 
bit range of 0 to 255, and a color value of 300 is obtained, data may be "clamped" into the range 
of 0 to 255, causing color data loss and distortion. 

In one embodiment, the method includes obtaining color values; mapping the color 
values to one of: an expanded RGB/RGBA or an expanded sRGB/sRGBA space; and labeling an 
r =10 image determined by mapped color values as an expanded RGB/RGBA or expanded 
y sRGB/sRGB A colorspace image. The expanded RGB/RGBA or sRGB/SRGBA space may 
include at least the visible range of color values. Also, the expanded RGB/RGBA or 
sRGB/SRGBA space may be described as a colorspace defined by a chromaticity diagram that 
% m extends into negative component values and beyond 1 .0 when normalized to 1 .0 in RGB or 
;?J5 sRGB, respectively. With respect to terminology, as used herein, "RGB/RGBA" is defined to be 
. ij interchangeable with the terms "RGB/ARGB" or "RGB/RGB(A)" That is, there is no 

distinction between the recited terms, and no specific ordering of elements is indicated by the 
terminology. 

Mapping the color values to an expanded RGB/RGBA or expanded sRGB/sRGB A space 
20 may include utilizing multiplication of Ro,Go,B 0 values by a predetermined matrix, where the 
Ro,Go,and B 0 values denote normalized red, green and blue components for a color value. The 
Ro,Go,B 0 values may be predetermined based on X, Y and Z values, where X, Y, and Z denote 
193 1 CIE XYZ values whose Y value has been normalized to 1. Where the Ro,G 0 ,and B 0 values 
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denote normalized red, green and blue components for a color value, the Ro,Go,and Bo values 
may simply be multiplied by 8192 to obtain the 16 bit components Ri6, Gie, andBie. Where 16 
bits are used for color data values, a sign, integer and decimal portion may be set forth, and 
where selected, transparency information may be stored. Clipping may be used to convert 16 bit 
5 values to 8 bit values. As desired, color data values may be non-premultiplied, premultiplied, or 
normalized premultiplied. 

In a second embodiment, in a digitized image processing system in which an image 
digitizer outputs digital signals representing an image, a method for providing high quality error- 
free conversion of color images from measured color values includes the steps of: mapping the 

10 color values to an expanded colorspace wherein the expanded colorspace includes values beyond 
a visible range of color values and labeling an image determined by the color values mapped to 

j:= the expanded colorspace as an expanded colorspace image. The modifications described for the 

J;" above method may be implemented in the method set forth for the second embodiment. 

The methods may each be implemented as steps of computer-executable instructions in a 

l 4 5 computer-readable medium. 

':!: In a digitized image processing system in which an image digitizer outputs digital signals 

representing a color image to an apparatus that converts the digital signals to a high quality error- 
free expanded colorspace color image, the apparatus includes an expanded colorspace mapper 
and an image labeller. The expanded colorspace mapper is used for mapping the digital signals 

20 to expanded colorspace values wherein the expanded colorspace values include values beyond a 
visible range of color values. The image labeller is coupled to the expanded colorspace mapper 
and is used for labeling an image determined by expanded colorspace values as an expanded 
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colorspace image. The apparatus may be adjusted further in accordance with the description 
above. 

5 

Brief Description of the Drawings 
Figure 1 is a schematic graphical representation of a laser display colorspace upon a CBE 
colorspace that shows the full gamut of the visual spectrum as is known in the art. 

Figure 2 is a schematic graphical representation of colorspaces for a representative Canon 
JLO CLC500 color copier/printer, General RGB color values, and sRGB values upon a CIE 
}':\ colorspace diagram as is known in the art. 

j:~ Figure 3 is a schematic graphical representation of one embodiment of a colorspace in 

I- accordance with the present invention. 

Figure 4 is a flow chart showing steps in accordance with one embodiment of the method 
5 and a computer-readable medium for implementing the present invention, 
j!? Figure 5 is a flow chart showing steps in accordance with another embodiment of the 

method and a computer-readable medium for implementing the present invention. 

Figure 6 is a block diagram of one embodiment of an apparatus in a digitized image 
processing system for converting color images in accordance with the present invention. 
20 Figure 7 is a block diagram of a computer system that may be used to implement the 

method of the present invention. 
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Figure 8 is a flow chart showing one embodiment of steps of a method of representing 
color in images using color data values for an expanded colorspace substantially without visually 
perceptible error in accordance with the present invention. 

Figure 9 is a flow chart show one embodiment of steps of the method of the present 
5 invention providing for representing at least one of: super transparent and super opaque colors 
using an alpha channel. 

Detailed Description of the Invention 
As shown in Figure 3, extending the range of color data values for the chromaticity 
4 0 diagram for sRGB beyond 1 .0 and below 0.0 on the x and y axes is illustrated by the triangle 
i7i DEF 302, 304, 306, so that the present invention provides a chromaticity diagram that 
J;!; encompasses all visible color values. For example, in one embodiment, color data values may be 
expressed in a signed 16-bit integer (13 bits are used for decimals) with a triangle corresponding 
to (3.24, -0.97, 0.06), (-L54, 1.88, -0.20), and (-0.50, 0.04, 1.01), thus covering each component 
!:;i5 within -4 to 4. 

s .™ By allowing the component of each primary color to be negative and to extend beyond 

1 .0 (when normalized to 1 .0 in sRGB), the present invention's gamut is larger than the visible 
color space. The data scheme of the present invention,"XsRGB" is also known as "sRGB64. 
"XsRGB" will be used hereafter to represent the color data scheme of either XsRGB or sRGB64. 

20 Advanced graphic systems require anti-aliasing features (removing ragged edges) and 

blending (translucency) effects. To achieve these anti-aliasing features and blending effects, an 
extra component called an "alpha channel" was introduced. To utilize the alpha channel, the 
linear color components must be expressed in terms of their intensities. However, sRGB and 
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other color management systems typically store color data values in non-linear 8-bit values per 
channel. The non-linearity is expressed as a "gamma value". For example, Microsoft's and 
Apple's color management systems are 2.2 and 1.8, respectively. When only 8 bits were 
available for color data value representation, it was necessary to convert the color data non- 
5 linearly, creating a large gap in the lower intensity values and causing the resulting images to 
show contours. However, when the size of each component is extended to higher bit (12 bit or 
higher), the non-linearity requirement is eliminated. Thus, in an embodiment with 12 or more 
bits for each component, color profiles do not require clipping to a narrower gamut and 
component values do not have to be non-linearized, avoiding confusion of different gamma 
40 values in different color standards. Since, in this embodiment, color values are standardized, 
standard images may be stored in the XsRGB format without attaching a standardized profile 
J;; such as an ICC (International Color Consortium) profile to clarify the colors intended. Where 
4= desired, an alpha channel may be implemented to store information on transparency. Also, 
where selected, the color values may be premultiplied by alpha channel values to provide 
5 efficient blending. 

;!f It is better to define XsRGB more generally by a 4x4 matrix. Also, there is a conversion 

rule for XsRGB with a different white point. 

XsRGB is linear in the visual intensity of each component. Hence, XsRGB can relate 

linearly to 1931 CIE XYZ values. Let R 0 ,G Q9 and B 0 denote the normalized red, green, and 
20 blue components, respectively. Let X, Y f and Z denote 1931 CIE XYZ values, but Y is 

normalized to 1 instead of 100. The relationship between the normalized XsRGB and XYZ are 
given by a 4x4 matrix. 
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Only 12 coefficients are needed to define XsRGB. In addition to the rotational part {m^ , etc.), 
the transitional part (t R , etc.) is used. With this notation, the white point may be addressed as 
well as the black point. Using the inverse of the above matrix, the reverse relation from XsRGB 
to CIE XYZ space is given by: 
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A 16 bit definition of RGB components is given by: 
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In equation (2c), no gamma corrections are required since a sufficient number of bits are 
available to describe the color data (here, 16 bits). 

It is desirable for XsRGB to have a simple transform to sRGB in D65. D50 and D65 are 
the standard illuminans (the spectrum distributions of the light source) defined by CIE. D50 and 
D65 are the spectrum distributions similar to the Black Body radiation of 5000 and 6500 Kelvin, 
respectively. Indeed, it is desirable for XsRGB to be identical to sRGB when its value is inside 
the range of sRGB. From the sRGB specification, the coefficients of Eq. (lb) and Eq. (2b) are 
determined as: 



M D65 = 



and 



AS M~" = 



D65 



3.2410 
- 0.9692 
0.0556 
0 



0.4124 
0.2126 
0.0193 
0 



-1.5374 
1.8760 
-0.2040 
0 



0.3576 
0.7152 
0.1192 
0 



-0.4986 0 
0.0416 0 
1.0570 0 
0 1 



0.1805 
0.0722 
0.9505 
0 



(3a) 



(3b) 



The white point of D65 is (x D65 ,y D65 ) = (0.3127, 0.3291); the corresponding CEE XYZ values 



are 



20 



^65=^65/^65 =0.9502 

1^=1.0 

Z D65 =(l.0-x D65 -y D65 )/y D65 =imS7 



(4) 
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Note that the Y-value at the white point is 1. When the device has the different white point 
(X w , Y w , Z w ) , the CIE XYZ coordinates for the appearance match must be transformed by the 
scaling matrix. 
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D65 l^w 
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0 



0 
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(5a) 
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and its inverse is 
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(5b) 



The transformation matrix from XYZ to XsRGB at this white point is given by 



M w = M D65 S W 



and its transverse matrix is given by 



m-^=s-:m- d \ 5 



(6a) 



(6b) 



20 For an example, the white point of D50 is (x D50 , y DS0 ) = (0.3457,0.3585) . The corresponding 
CIE XYZ value is (X DS0 , Y D50 , Z D50 ) = (0.9643,1,0. 825 1) . Hence the scaling matrices are 
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and 



10 



'050 



1.0148 
0 
0 
0 



0 

1.0 

0 
0 



0 
0 

0.7579 
0 



(7b) 



The resultant transformation matrices for D50 are: 



M D50 = 
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-0.9550 
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(8a) 
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0.4185 
0.2126 
0.0146 
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0.0903 
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0.1832 
0.0722 
0.7204 
0 



(8b) 



The appearance match is obtained if the XsRGB values are calculated from the 
conversion matrix of the device white point. The absolute match may be obtained if the 
|5 conversion matrix of D65 is used irrespective of the device white point. 

Let (R W ,G W ,B W ) denote the normalized RGB value obtained with the matrix M w defined 
in Eq. (6a) for the specific white point The (R W> G W ,B W ) value is used to do the appearance 
match and is called the appearance RGB value. When the absolute match is needed, the RGB 
values (i? 0 , G 0 , B 0 ) are used by using the matrix Md65 defined in Eq. (3a), which is called the 
20 absolute RGB value. The absolute RGB value is obtained from the appearance RGB value by 
the following equation: 
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The reverse relation is obtained as: 
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Since the XsRGB space is directly linked to CIE XYZ space, it is possible to produce the 
XsRGB measuring device. The new XsRGB device may be produced by adding the matrix 
conversion routines to the existing colorimeters. XsRGB values may be measured directly from 
the device. The device may produce the appearance RGB values and the absolute RGB values. 

The default XsRGB space is the case of D65 that is linked to sRGB. Since there is no 
translational part, Eq. (la) with M = Md65 can be written with a 3 x 3 matrix as : 
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Allowing each component to go from -4 to 4 by X, Y, Z values, wherein X, Y, and Z 
denote 1931 CIE XYZ values wherein Y has been normalized to 1 instead of 100, 
covers a range larger than the range covered by XYZ. The equation (10) provides one 
embodiment of a floating point format for XsRGB. When the 16 bit version of XsRGB is 

utilized, a signed 16 bit integer is used and 8192 (= 2 13 ) is interpreted as 1 in the normalized 
value. Hence, the lowest 13 bits are used for the decimal portion. 

Conversion from 16 bit color data for the XsRGB format to an 8 bit sRGB format is as 
follows: Let C\e and Cg denote one of the components in 16 bit XsRGB format and 8 bit sRGB 
format, respectively. The relationships are: 
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C 0 = C 16 / 8192 (Corresponding to the normalized linear XsRGB) 
C 8 =0 for C 16 <0 

C 8 = 12.92 x C 0 x 255 for 0 < C 0 < 0.00304 (0 < C 16 < 24) 

C 8 = (l.055 x C 0 {10/ 2A) - 0.055)x 255 for 0.00304 < C 0 < 1 (25 < C 16 < 8192) 

5 C 8 - 255 for C 0 > 1 (C 16 > 8192) (1 1) 

The above conversions correspond to clipping below 0 and above 8192 of the 16 bit 
XsRGB when converting to 8 bit sRGB. The clipping routine may be further modified as 
desired. 

The reverse relationships are: 
;l0 Ci6 = 2.4865 xC 8 for0< C 8 <10 

U l Ci 6 = 8.192 x [(C 8 + 14.025)/269.025] 2 * 4 for 11 < C 8 < 255 . (12) 



The extension of sRGB in accordance with the present invention provides a number of 
□:J advantages. For example, blending operations with an alpha channel may be directly applied to 
15 XsRGB since XsRGB is linear. The XsRGB profiles may easily be obtained from the CIE XYZ 
profiles. When XsRGB is used for color reference, there is no need to rotate color components 
to display each component in an 8 bit sRGB device. Only gamma correction described in (Eq. 
12) above need be used to convert to 8 bit sRGB. Even without an exact calibration, XsRGB 
yields satisfactory conversion for output for color monitors. The scanned images may generally 
20 be stored in XsRGB format without losing bit depths since most scanners produce data in not 
more than 12 bits in each color component. 
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Where the alpha channel is also utilized for transparency information, the present 
invention is referenced as "XsRGBA". For XsRGBA, the additional 16 bit components are used 
as the alpha channel to store transparency information. 

Let us first introduce the normalized alpha channel A 0 . The values 0 and 1 of A 0 are 
5 regarded as transparent and opaque, respectively. The four components {A Q , R Q , G 0 , B 0 ) 
constitute one color value. Multiplying 8192 by each component the XsRGBA component 
A l€ , R 16 , G u , B l6 , called the non-premultiplied XsRGBA, is obtained and (A 0 , R 0 , G 0 , B 0 ) is 
called the normalized non-premultiplied XsRGBA . 

When blending operations are processed, it is more efficient to use RGB values which are 

Jo multiplied by the alpha value. The four components (a o , R* 0 , G 0 , B Q ), where R' 0 = A 0 R 0 , 

G 0 = A 0 G Q , and 5^ = A 0 B Q , are called the normalized premultiplied XsRGB. Multiplying 8192 
by each component, the XsRGBA component A l6 ,R i6 ,G l6 ,B[ 6 is obtained. This is called the 

;L, premultiplied XsRGBA. 

Each color component is allowed to go beyond 1 and go below 0. The meaning of alpha, 
5 J 5 A 0 , is considered in the following way. When a source image, S, is overlaid on the destination 
image, D, the resultant image, D } , is obtained as 

d'=as + (l-a)d (13) 
20 where s, d, and d y are one of the normalized color components of the image S,D, and U at the 
corresponding pixels, respectively, and a is the alpha value of the source image S at the 
considering pixel. When a = 0, the resultant image remains the same as the destination image. 
This case is called transparent. When a = 1, the resultant image is the same as the source image. 
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This case is called opaque. When a is between 0 and 1, the resultant image is the mixed image 
between the source and destination images. Usually a is a translucency parameter ranging from 
transparent (=0) to opaque (=1). However, Eq. (13) may be regarded as the interpolation 
equation. Hence, when a< 0 or a > 1, Eq. (13) is very well defined and is extrapolating the 
5 source and destination images. The alpha value is an interpolation/ extrapolation parameter, a 
may be smaller than 0 or larger than 1. a < 0 is defined as "super transparent" and a > 1 is 
defined as "super opaque." Clearly, colors with the super transparent or super opaque alpha value 
may fall within an RGB space or outside the RGB space. 

Figure 4 is a flow chart showing steps in accordance with one embodiment of the method 
,10 of the present invention. The method provides high quality error-free conversion of color images 

and includes the steps of: obtaining 402 color values; mapping 404 the color values to an 
1 expanded sRGB/sRGBA space; and labeling 406 an image determined by mapped color values 
4= as an expanded sRGB/sRGBA colorspace image. Obtaining 402 the color values may be simply 
receiving input color values; alternatively, obtaining 402 color values may include measuring the 
;::f 5 color values. The expanded sRGB or sRGBA space typically includes at least the visible range 
Z of color values. Thus, the expanded sRGB or sRGBA space generally includes a colorspace 
defined by a chromaticity diagram that extends into negative component values and beyond 1 .0 
when normalized to 1 .0 in sRGB. Where selected, mapping 404 the color values to an expanded 
sRGB or sRGBA space may include utilizing multiplication of R\ , G\ , and B\ values by a 
20 predetermined matrix, where thei?' 0 , G\ , and B\ values denote normalized red, green and blue 
components for a color value. In one embodiment, the R\ , G\ , , and B\ values are obtained 
in accordance with equation (10) above. Where color data values have 16 bits, 1 bit is used for a 
sign, 2 bits are used for an integer part, and a remaining 13 bits are used for a decimal portion. 
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Thel 6 bit components R l6 ,G 16 , and Z? 16 for the color data values may be given by equation (2c). 

Where color data values have been mapped to 16 bit values, mapping may include clipping the 

16 bit values below 0 and above 8192 to convert the 16 bit values to 8 bit values As described 

above, the color data values may be non-premultiplied, premultiplied or normalized 
5 premultiplied color data values. 

Figure 5 shows another embodiment of steps in accordance with the method of the 

present invention. In a digitized image processing system in which an image digitizer outputs 

digital signals representing an image, the method provides high quality error-free conversion of 

color images from measured color values. In this embodiment, the method includes the steps of: 
r |0 mapping 502 the color values to an expanded colorspace wherein the expanded colorspace 
Lij includes values beyond a visible range of color values; and labeling 504 an image determined by 

the color values mapped to the expanded colorspace as an expanded colorspace image. Also, the 
; ^ expanded colorspace may include a colorspace defined by a chromaticity diagram that extends 

into negative component values and beyond 1 .0 when normalized to 1 .0 in sRGB. Mapping the 
nJ5 color values and obtaining the color values may be accomplished as set forth above. Where 16 
jj bit color data values are utilized, the bits may be allocated as set forth above, and 16 bit 

components 7? 16 ,G 16 , and B l6 of color data values may also be computed as set forth above. 

Where desired, clipping, storage of transparency information and premultiplication of color data 

values may be achieved as discussed above. 
20 The above-described methods may be implemented by a computer-readable medium 408, 

506 having computer-executable instructions for performing the steps. 

Figure 6 is a block diagram of one embodiment of an apparatus in a digitized image 

processing system for converting color images in accordance with the present invention. In the 
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digitized image processing system 602, an image digitizer 604 that utilizes color image 
information to output digital signals representing a color image to the apparatus 606 that converts 
the digital signals to a high quality error-free expanded colorspace color image. The apparatus 
606 includes: an expanded colorspace mapper 608, for mapping the digital signals to expanded 
5 colorspace values wherein the expanded colorspace values include values beyond a visible range 
of color values; and an image labeller 610, coupled to the expanded colorspace mapper 608, for 
labeling an image determined by expanded colorspace values as an expanded colorspace image. 
The expanded colorspace may include a colorspace defined by a chromaticity diagram that 
extends into negative component values and beyond 1 .0 when normalized to 1 .0 in sRGB. The 

; 40 expanded colorspace mapper may utilize multiplication of R 0 , G 0 , B 0 values by a predetermined 
matrix to map the color values to an expanded colorspace. The R 0 , G 0 , B 0 values may be 
obtained using equation (9). Where desired, the color data values and their bit components, 
clipping, transparency information storage and premultiplication and normalization of color data 
values may be as described for the methods above. 

ill 5 Color operations defined in the RGB/RGB A colorspace may be extended to the expanded 

RGB/RGB A colorspace. Three examples of color operations in the expanded RGB/RGBA 
colorspace include: 

1 . Interpolation between two RGB colors X = ( R x , G x , B x ) and Y - ( R y , G y , B y ). The RGB 
color Z = (R Z ,G 2 ,B Z ) that is linearly interpolated between X and Y is given by: 

20 

R,=(l-d)R x + dR, 

G z =(l-d)G x +dG y 

B 2 =(l-d)B x +dB y 
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where d is the normalized distance of Z from X to Y, and d = 0 at X and d = 1 at Y. 

2. Digital image composition operations that combine two non-premultiplied RGB A colors. 
For example, one of the operations, X over Y, where X = ( R x , G x , B x , A x ) and Y = 
{R y ,G y ,B y ,A y ), produces color Z = (R 2 ,G 2 ,B 2 ,A Z ). The formula is given by: 

R 2 =A x R x +(l-A x )R y 
G 2 =A x G x+ (l~A x )G y 
B 2 =A x B x +(l-A x )B y 
A 2 =A x A x +(l-A x )A y 

3. Image convolution operations. For example, a blur filter matrix M is given by : 

"1/16 1/8 1/16" 
1/8 1/4 1/8 
1/16 1/8 1/16_ 

The blur equation is for each color component. Assuming a RGB color component of a pixel at 
location (i, j) is C(ij), the resulting RGB color component of the pixel after the blur operation is 
given by: 

(l/16)C(i-l, j-1) + (l/8)C(i-l, j) + (l/16)C(i-l, j+1) + 
(l/8)C(i, j-1) + (l/4)C(i, j) + (l/8)C(i, j+1) + 
(l/6)C(i+l, j-1) + (l/8)C(i+l, j) + (l/16)C(i+l J+1) 

With reference to Figure 7, an exemplary system for implementing the invention includes 
a general purpose computing device in the form of a conventional personal computer 720, 
including a processing unit/processor 721, a system memory 722, and a system bus 723 that 
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couples various system components including the system memory to the processing 
unit/processor 721. The system bus 723 may be any of several types of bus structures including 
a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of 
bus architectures. The system memory includes read only memory (ROM) 724 and random 
5 access memory (RAM) 725. A basic input/output system 726 (BIOS), containing the basic 
routines that helps to transfer information between elements within the personal computer 720, 
such as during start-up, is stored in ROM 724. The personal computer 720 further includes a 
hard disk drive 727 for reading from and writing to a hard disk, not shown, a magnetic disk drive 
728 for reading from or writing to a removable magnetic disk 729, and an optical disk drive 730 

40 for reading from or writing to a removable optical disk 73 1 such as a CD ROM or other optical 
media. The hard disk drive 727, magnetic disk drive 728, and optical disk drive 730 are 
connected to the system bus 723 by a hard disk drive interface 732, a magnetic disk drive 

*S interface 733, and an optical drive interface 734, respectively. The drives and their associated 
computer-readable media provide nonvolatile storage of computer readable instructions, data 

;flj5 structures, program modules and other data for the personal computer 720. Although the 

exemplary environment described herein employs a hard disk, a removable magnetic disk 729 
and a removable optical disk 731, it should be appreciated by those skilled in the art that other 
types of computer readable media which can store data that is accessible by a computer, such as 
magnetic cassettes, flash memory cards, digital video disks, Bernoulli cartridges, random access 

20 memories (RAMs), read only memories (ROMs), and the like, may also be used in the 
exemplary operating environment. 

A number of program modules may be stored on the hard disk, magnetic disk 729, optical 
disk 31, ROM 724, or RAM 725, including an operating system 735, one or more application 
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programs 736, other program modules 737 and program data 738. A user may enter commands 
and information into the personal computer 720 through input devices such as a keyboard 740 
and pointing device 742. Other input devices (not shown) may include a microphone, joystick, 
game pad, satellite dish, scanner or the like. These and other input devices are often connected 
5 to the processing unit 721 through a serial port interface 746 that is coupled to the system bus, 
but may be connected by other interfaces, such as a parallel port, game port or a universal serial 
bus (USB). A monitor 747 or other type of display device is also connected to the system bus 
723 via an interface, such as a video adapter 748. In addition to the monitor, personal computers 
typically include other peripheral output devices (not shown) such as speakers and printers. 

10 The personal computer 720 may operate in a networked environment using logical 

connections to one or more remote computers, such as a remote computer 749. The remote 
. j:= computer 749 may be another personal computer, a server, a router, a network PC, a peer device 
or other common network node, and typically includes many or all of the elements described 
above relative to the personal computer 720, although only a memory storage device 750 has 
yl5 been illustrated in Figure 7. The logical connections depicted in Figure 7 include a local area 

'!;( network (LAN) 75 1 and a wide area network (WAN) 752. Such networking environments are 

: " commonplace in offices, enterprise-wide computer networks, intranets and the Internet. 

When used in a LAN networking environment, the personal computer 720 is connected to 
the local network 751 through a network interface or adapter 753. When used in a WAN 

20 networking environment, the personal computer 720 typically includes a modem 754 or other 

means for establishing communications over the wide are network 752, such as the Internet. The 
modem 754, which may be internal or external, is connected to the system bus 723 via the serial 
port interface 746. In a networked environment program modules depicted relative to the 
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personal computer 720, or portions thereof, may be stored in the remote memory storage device. 
It will be appreciated that the network connections shown are exemplary and other means of 
establishing communications between the computers may be used. 

Thus, as shown in Figure 8, the present invention provides a method of representation of 
color in images using color data values for an expanded colorspace, e.g., an expanded 
RGB/RGBA colorspace, that encompasses at least a visually perceptible colorspace, having at 
least a precision sufficient to represent visible colors substantially without visually perceptible 
error. The method includes the steps of:representing 802 the color data values as perceptually 
visible data values in an expanded RGB/RGBA space and labeling 804 an image determined by 
the perceptually visible data values as an expanded RGB/RGBA colorspace image. The method 
may also include mapping 806 the perceptually visible data values of the image to color data 
values of another selected destination colorspace. Where the perceptually visible data values 
may lie outside a predetermined range, the mapping may include clipping the perceptually 
visible data values for the selected destination colorspace. Mapping may include utilizing a 
predetermined transformation function that maps the perceptually visible data values to color 
data values in the selected destination colorspace. Typically, the expanded RGB/RGBA 
colorspace is linear in visual intensity. 

As shown in Figure 9, the method of the present invention provides for representing at 
least one of: super transparent and super opaque colors using an alpha channel. The method 
includes the steps of: representing 902 color data values as perceptually visible super 
transparent/super opaque data values in a colorspace and labeling 904 an image determined by 
the perceptually visible super transparent/super opaque data values as a super transparent/super 
opaque colorspace image. Color operations defined in the RGB/RGBA colorspace may be 
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extended to the expanded RGB/RGBA colorspace. In one embodiment, the alpha channel 
includes 16 bits to provide increased precision. 

Although the present invention has been described in relation to particular preferred 
embodiments thereof, many variations, equivalents, modifications and other uses will become 
apparent to those skilled in the art. It is preferred, therefore, that the present invention be limited 
not by the specific disclosure herein, but only by the appended claims. 
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Claims 

What is claimed is: 

1 . A method for providing representation of high quality, substantially visually error-free 
5 color in images, comprising the steps of: 

mapping color to color data values in an expanded RGB/RGBA space; and 
labeling an image determined by mapped color values as an expanded 
RGB/RGBA colorspace image. 

10 2. The method of claim 1 wherein mapping includes, where colors from a selected 

colorspace are converted to the expanded RGB/RGBA colorspace, mapping color data values of 
a source colorspace image to color data values of the expanded RGB/RGBA colorspace. 

3. The method of claim 1 wherein mapping includes, where colors in the expanded 

!:J5 RGB/RGBA colorspace are converted to a selected colorspace, mapping color data values of the 
'I;: expanded RGB/RGBA colorspace to color data values of a destination colorspace. 

4. The method of claim 3 wherein, where the color data values in the expanded RGB/RGBA 
colorspace lie outside a range of the destination colorspace, mapping includes clipping the color 

20 data values for the destination colorspace. 



5. The method of claim 3 wherein, where the color data values in the expanded RGB/RGBA 
colorspace lie outside the range of the destination colorspace, mapping includes utilizing a 
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predetermined transformation function that maps the color data values to color data values in the 
selected destination colorspace. 



6. The method of claim 1 wherein the expanded RGB/RGB A colorspace is linear in visual 
5 intensity. 

7. The method of claim 1 wherein the expanded RGB/RGBA space is an XsRGB 
colorspace that includes at least the visible range of color values, and where selected, wherein 
the expanded RGB/RGBA space includes an alpha channel for at least one of: transparency 

,10 information and opaqueness information. 



8. The method of claim 1 wherein the expanded RGB/RGBA space includes a colorspace 
)" defined by a gamut that extends into negative component values and beyond 1 .0 when 
L normalized to 1 .0 in RGB. 

is 

: jl: 9. The method of claim 1 wherein mapping the color values to an expanded RGB/RGBA 

space includes utilizing multiplication of R 0 ,G Q9 B 0 values by a predetermined matrix, where the 
J? 0 , G 0 , and B 0 values denote normalized numerically linear red, green and blue components for a 
color value. 

20 

1 0. The method of claim 9 wherein the R 0 , G 0 , B 0 values are obtained in accordance with the 
following: 
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~x~ 




Y 




Z 



3.241 -1.5374 -0.4986 
-0.9692 1.8760 0.0416 
0.0556 -0.2040 1.0570 



wherein X, Y, and Z denote 1931 Commission Internationale de l'Eclairage XYZ values 
where Y has been normalized to 1 . 

5 11. The method of claim 1 wherein, wherein each color data value uses a signed 16 bit 
integer and 13 bits are used as a decimal portion. 

12. The method of claim 1 1 wherein 16 bit components R l6 , G 16 and B l6 are given by: 







X" 


G l6 


= 8192 x 


Go 






. B o. 



where the R 0 ,G 0 , and B 0 values denote normalized numerically linear red, green and blue 
components for a color value. 



1 3 . The method of claim 4 wherein mapping includes, where color data values have been 
15 represented using signed 16 bit values with 13 bits of decimal precision, clipping the 16 bit 
values below 0 and above 8192 to convert the 16 bit values to 8 bit values. 



20 



The method of claim 1 wherein the color data values are one of: 
non-premultiplied color data values; 
premultiplied color data values; and 
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normalized numerically linear premultiplied color data values. 

15. In a digitized image processing system in which an image digitizer outputs digital signals 
representing an image, a method for providing representation of high quality, substantially 
5 visually error-free color images from measured color values, comprising the steps of: 

mapping the measured color values to an expanded colorspace wherein the 
expanded colorspace includes values beyond a visible range of color values; and 

labeling an image determined by the color values mapped to the expanded 
colorspace as an expanded colorspace image. 

40 

hi 16. The method of claim 15 wherein the expanded colorspace includes an XsRGB colorspace 
defined by a gamut that extends into negative component values and beyond 1 .0 when 

4= normalized to 1 .0 in RGB , and where selected, wherein the expanded RGB/RGBA space 
includes an alpha channel for at least one of: transparency information and opaqueness 

![.I5 information 

1 7. The method of claim 1 5 wherein mapping the color values to an expanded colorspace 
includes utilizing multiplication of R Q , G 0 , B 0 values by a predetermined matrix, where the R 0 , 

G 0 9 B 0 values denote normalized numerically linear red, green and blue components for a color 
20 value. 

18. The method of claim 15 wherein the R Q , G 0 , B 0 values are obtained in accordance with 
the following: 
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3.241 -1.5374 -0.4986 X 
-0.9692 1.8760 0.0416 Y 
0.0556 -0.2040 1.0570 Z 



wherein X, Y, and Z denote 1931 Commission Internationale de l'Eclairage XYZ values 
wherein Y has been normalized to 1 . 
5 19.The method of claim 15 wherein, wherein each color data value uses a 16 bit integer and 13 
bits are used as a decimal portion. 



20. The method of claim 15 wherein 16 bit components i? 16 , G 16 , and B l6 of color data 
values are given by: 
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where the R 0 , G 09 B Q values denote normalized numerically linear red, green and blue 
components for a color value. 



15 21. The method of claim 15 wherein mapping includes, where color data values have been 
represented using signed 16 bit values with 13 bits of decimal precision, clipping the 16 bit 
values below 0 and above 8192 to convert the 16 bit values to 8 bit values. 



22. The method of claim 15 wherein the color data values are one of: 
20 non-premultiplied color data values; 
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premultiplied color data values; and 

normalized numerically linear premultiplied color data values. 

23. A computer-readable medium having computer-executable instructions for performing 
5 the steps recited in claim 15. 

24. In a digitized image processing system in which an image digitizer utilizes color image 
information to output digital signals representing a color image to an apparatus that uses the 
digital signals to provide representation of a high quality visually error-free expanded colorspace 

.40 color image, the apparatus comprising: 

hi an expanded colorspace mapper, for mapping the digital signals to expanded 

£ colorspace values wherein the expanded colorspace values include values beyond 

k a visible range of color values; and 

^ an image labeller, coupled to the expanded colorspace mapper, for labeling an 

::^5 image determined by expanded colorspace values as an expanded colorspace 

;ii image. 

25. The apparatus of claim 24 wherein the expanded colorspace includes an XsRGB 
colorspace defined by a gamut that extends into negative component values and beyond 1.0 

20 when normalized to 1 .0 in RGB, and where selected, wherein the expanded RGB/RGBA space 
includes an alpha channel for at least one of: transparency information and opaqueness 
information 
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26. The apparatus of claim 24 wherein the expanded colorspace mapper utilizes 
multiplication of R 0 , G 0 , 5 0 values by a predetermined matrix to map the color values to an 
expanded colorspace. 

27. The apparatus of claim 24 wherein the R Q , G 0 , B 0 values are obtained in accordance 
with the following: 



' 3.241 -1.5374 -0.4986 
-0.9692 1.8760 0.0416 
0.0556 -0.2040 1.0570 



wherein X, Y, and Z denote 1931 Commission Internationale de PEclairage XYZ values 
where Y has been normalized to 1 . 
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28. The apparatus of claim 24 wherein, wherein each color data value uses a 16 bit integer 
and 13 bits are used as a decimal portion. 



29. The apparatus of claim 24 wherein 16 bit components of color data values R l6 , G 16 ? and 
B 16 are given by: 
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where the R 0 , G 0 , B 0 values denote normalized numerically linear red, green and blue 
components for a color value. 
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30. The apparatus of claim 24 wherein, where color data values have been represented using 
signed 16 bit values with 13 bits of decimal precision, the expanded colorspace mapper clips the 
16 bit values below 0 and above 8192 to convert the 16 bit values to 8 bit values. 

5 31. The apparatus of claim 24 wherein the color data values are one of: 
non-premultiplied color data values; 
premultiplied color data values; and 

normalized numerically linear premultiplied color data values. 

AO 32. A computer-readable medium having computer-executable instructions for performing 
steps comprising: 

t jiz mapping color values to an expanded RGB/RGBA space; and 

4= labeling an image determined by mapped color values as an expanded 

RGB/RGBA colorspace image. 

m 

^ 33 . The computer-readable medium of claim 32 wherein the expanded RGB/RGBA space 
includes an XsRGB colorspace that includes at least the visible range of color values, and where 
selected, wherein the expanded RGB/RGBA space includes an alpha channel for at least one of: 
transparency information and opaqueness information. 
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34. The computer-readable medium of claim 32wherein the expanded RGB/RGBA space 
includes a colorspace defined by a gamut that extends into negative component values and 
beyond 1.0 when normalized to L0 in RGB. 

5 35. The computer-readable medium of claim 32 wherein mapping the color values to an 
expanded RGB/RGBA space includes utilizing multiplication of R 0 , G Q9 B Q values by a 
predetermined matrix. 

36. The computer-readable medium of claim 32 wherein the R 0 , G 0 , B 0 values are obtained 
£|0 in accordance with the following: 
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wherein X, Y, and Z denote 1931 Commission Internationale de FEclairage XYZ values 
Oj where Y has been normalized to 1 . 

Mf5 37. The computer-readable medium of claim 32 wherein each color data value uses a signed 
16 bit integer and 13 bits are used as a decimal portion. 

38. The computer-readable medium of claim 32 wherein 16 bit components R 16 , G 16 , and 
B 16 are given by: 
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where the R 0 , G 0 , B 0 values denote normalized numerically linear red, green and blue 
components for a color value. 



39. The computer-readable medium of claim 32 wherein mapping includes, where color data 
5 values have been represented using signed 16 bit values with 13 bits of decimal precision, 

clipping the 16 bit values below 0 and above 8192 to convert the 16 bit values to 8 bit values. 

40. The computer-readable medium of claim 32 wherein the color data values are one of: 

non-premultiplied color data values; 
;;|0 premultiplied color data values; and 

UJ normalized numerically linear premultiplied color data values. 



41 . The computer-readable medium of claim 32 wherein the expanded RGB/RGB A space 
includes an alpha channel for at least one of: transparency information and opaqueness 

i |5 information. 

42. A method of representation of color in images using color data values for an expanded 
RGB/RGB A space, having at least a precision and range sufficient to represent substantially all 
humanly visible colors substantially without visually perceptible error, the method including the 

20 steps of: 

representing the color as data values in an expanded RGB/RGBA space; and 
labeling an image determined by the color data values as an expanded 
RGB/RGBA colorspace image. 
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43. The method of claim 42 wherein representing includes, where color data values from a 
selected colorspace are converted to the expanded RGB/RGBA space, mapping the color data 
values of a selected image colorspace to color data values of the expanded RGB/RGBA 
colorspace. 

44. The method of claim 42 wherein representing includes, where color data values in the 
expanded RGB/RGBA space are converted to a selected colorspace, mapping the color data 
values of the expanded RGB/RGBA colorspace to a selected destination colorspace. 

45. The method of claim 44 wherein, where the perceptually visible data values lie outside a 
predetermined range, the mapping includes clipping the color data valuesto a range of the 
selected destination colorspace. 

46. The method of claim 44 wherein the mapping includes utilizing a predetermined 
transformation function that maps the color data values to color data values in the selected 
destination colorspace. 

47. The method of claim 42 wherein the expanded RGB/RGBA colorspace is linear in visual 
intensity. 

48. A method for representing at least one of: super transparent and super opaque colors 
using an alpha channel, comprising the steps of: 
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representing color data values as perceptually visible super transparent/super 
opaque data values in a colorspace; and 

labeling an image determined by the perceptually visible super transparent/super 
opaque data values as a super transparent/super opaque colorspace image. 

49. The method of claim 1 wherein color operations defined in RGB/RGBA colorspace are 
extended to an expanded RGB/RGBA colorspace. 

50. The method of claim 48 wherein the alpha channel extends less than 0 and beyond 1 .0 
when normalized to 1.0. 

51. A method of representing color data values in images using color data as appearance 
RGB values, comprising the steps of: 

representing the color data values as normalized RGB values wherein each 

normalized RGB value G w , B w ) is obtained using a predetermined transformation matrix 
that is based on a preselected spectrum distribution; and 

labeling an image determined by the normalized RGB values as an appearance match 
image for corresponding X f Y f and Z values in accordance with 1931 Commission Internationale 
de TEclairage where Y has been normalized to 1. 

52. A device for representing color data values in images using color data as appearance 
RGB values, comprising: 

an expanded colorspace mapper, arranged to represent the color data values as 
normalized RGB values wherein each normalized RGB value (R W ,G W ,B W ) is obtained using a 
predetermined transformation matrix that is based on a preselected spectrum distribution; and 
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an image labeller, for labeling an image determined by the normalized RGB values as an 
appearance match image for corresponding X y Y f and Z values in accordance with 1931 
Commission Internationale de l'Eclairage where Y has been normalized to 1. 

5 

53. A method of representing color data values in images using color data as absolute RGB 
values, comprising the steps of: 

representing the color data values as absolute RGB values wherein each absolute RGB 
value (R q 9 G 0 , B Q ) is obtained using a predetermined transformation matrix that is based on a 
10 standard 1931 Commission Internationale de l'Eclairage D65 spectrum distribution; and 

labeling an image determined by the absolute RGB values as an absolute match image for 
corresponding X, Y, and Z values in accordance with 1931 Commission Internationale de 
F l'Eclairage where Y has been normalized to 1 . 

15 54. A device for representing color data values in images using color data as absolute RGB 
values, comprising: 

representing the color data values as absolute RGB values wherein each absolute RGB 
-M value (R Q 5 G 0 , B 0 ) is obtained using a predetermined transformation matrix that is based on a 

standard 1931 Commission Internationale de l'Eclairage D65 spectrum distribution; 
20 labeling an image determined by the absolute RGB values as an absolute match image for 

corresponding^ Y } and Z values in accordance with 1931 Commission Internationale de 

FEclairage where Y has been normalized to 1 . 
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Abstract of the Invention 
The present invention provides a method, apparatus and computer-readable medium for 
providing high quality substantially visually error-free conversion of color images. The method 
5 maps the color values to an expanded colorspace to represent substantially all colors without 
perceptible visual error and labels an image determined by the mapped color values as an 
expanded colorspace image. Thus, the present invention may be utilized to provide a linear color 
management system. In a 16 bit color data value system, transparency/opaqueness information 
may be stored, and premultiplied or premultiplied and normalized values may be used for 
,10 blending. 



CIE Diagram ~ 1»31 Z Degree Standard Observer 



x«ClE 




Figure 1 Prior Art 



CJE Diagram - WA\ 2 Dfcgre* Stawlai-d Observer 

x-CIE 




206 



Figure 2 Prior Art 



D (302) 




COMPUTER-READABLE MEDIUM 

^402 




OBTAINING COLOR VALUES 






^-404 




MAPPING THE COLOR DATA VALUES TO AN 
EXPANDED RGB/RGBA SPACE 






r 406 




LABELING AN IMAGE DETERMINED BY MAPPED 
COLOR VALUES AS AN EXPANDED RGB/RGBA 
COLORSPACE IMAGE 







Figure 4 



408 



COMPUTER-READABLE MEDIUM 

^-502 

MAPPING THE COLOR VALUES TO AN EXPANDED 
COLORSPACE WHEREIN THE EXPANDED 
COLORSPACE INCLUDES VALUES BEYOND A VISIBLE 
RANGE OF COLOR VALUES 



> 




LABELING AN IMAGE DETERMINED BY THE COLOR 
VALUES MAPPED TO THE EXPANDED COLORSPACE 
AS AN EXPANDED COLORSPACE IMAGE 



Figure 5 



506 



COLOR IMAGE 
INFORMATION 



602 



DIGITIZED IMAGE PROCESSING SYSTEM 



604 




606 



APPARATUS THAT CONVERTS DIGITAL SIGNALS TO 
EXPANDED COLORSPACE COLOR IMAGE 



EXPANDED 
COLORSPACE 
MAPPER 



IMAGE 
LABELLER 



608 



612 



Figure 6 



COLOR IMAGE 
DETERMINED BY 
EXPANDED 
COLORSPACE 
VALUES 



802 



REPRESENTING THE COLOR DATA VALUES AS 
PERCEPTUALLY VISIBLE DATA VALUES IN AN EXPANDED 

RGB/RGBA SPACE 



804 



LABELING AN IMAGE DETERMINED BY THE PERCEPTUALLY 
VISIBLE DATA VALUES AS AN EXPANDED RGB/RGBA 
COLORSPACE IMAGE 




806 



MAPPING THE PERCEPTUALLY VISIBLE DATA VALUES OF 
THE IMAGE TO COLOR DATA VALUES OF ANOTHER 
SELECTED DESTINATION COLORSPACE 



FIGURE 8 



REPRESENTING COLOR DATA VALUES AS PERCEPTUALLY 
VISIBLE SUPER TRANSPARENT/SUPER OPAQUE DATA VALUES IN 

A COLORSPACE 




902 

r 



LABELING AN IMAGE DETERMINED BY THE PERCEPTUALLY 
VISIBLE SUPER TRANSPARENT/SUPER OPAQUE DATA VALUES AS 
A SUPER TRANSPARENT/SUPER OPAQUE COLORSPACE IMAGE 



904 
FIGURE 9 




MS 137879.2 
3797.81834 



DECLARATION /POWER OF ATTORNEY FOR PATENT APPLICATION 
JOINT INVENTORS 



As the named inventors, we hereby declare: 

Our residences, post office addresses and citizenships are as stated next to our names below: 

We believe that we are the original, first and joint inventors of the subject matter which is claimed and for which a patent is 
sought on the invention entitled VISUALLY ERROR-FREE COLOR IMAGE REPRESENTATION, the specification of which 
is attached hereto. 

□ was filed on as application serial no. . 

We hereby state that we have reviewed and understand the contents of the above-identified specification, including the claims, as 
amended by any amendment referred to above. 

We acknowledge the duty to disclose information which is material to the examination of this application in accordance with Title 
37, Code of Federal Regulation, § 1 .56. 

Prior Foreign Applications 



We hereby claim priority benefits under Title 35, United States Code, § 1 19 of any foreign application(s) for patent or inventor's 
certificate listed below. We have also identified below any foreign application(s) for patent or inventor's certificate having a filing date 
before that of the application on which priority is based. 



Country 


Application 
Number 


Date of Filing 
(day, month, year) 


Date of Issue 
(day, month, year) 


Priority Claimed Under 35 
U.S.C. § 119 










Yes □ No □ 










Yes □ No □ 



Prior United States Application s) 



We hereby claim the benefit under Title 35 United States Code, § 120 of any United States patent application(s) listed below and, 
insofar as the subject matter of each of the claims of this application is not disclosed in the prior United States application in the 
manner provided by the first paragraph of Title 35, United States Code, § 1 1 2, we acknowledge the duty to disclose information which 
is material to the examination of this application in accordance with Title 37, Code of Federal Regulation, § 1.56 which occurred 
between the filing date of the prior application and the national or PCT international filing date of this application: 



Application Serial Number 


Date of Filing 

(day, month, year) 


Status — Patented, Pending, Abandoned 















LAW OFFICES Declaration - Joint Inventors 

Rev. Date 3/97 p aqe t 

Banner & Witcoff y 
1001 G Street, N.W. 
Washington, D.C. 20001-4597 
(202) 508-9100 



Power of Attorney 



And we hereby appoint, both jointly and severally, as our attorneys with full power of substitution and revocation, to prosecute 
this application and transact all business in the U.S. Patent and Trademark Office connected herewith as well as before any office or 
agency of a foreign country or any international organization in connection with any foreign counterpart application claiming priority to 
this application, including the power to appoint agents and local representatives in connection with such foreign applications, the 
following attorneys of Banner & Witcoff, their registration numbers being listed after their names: 



Robert F. Altherr Reg. No. 31 ,81 0 

Donald W. Banner Reg. No. 17,037 

Mark T. Banner Reg. No. 29,888 

Pamela I. Banner Reg. No. 33,644 

James V. Callahan Reg. No. 20,095 

Alan I. Cantor Reg. No. 28,163 

Marc S. Cooperman Reg. No. 34,143 

Laura J. DeMoor Reg. No. 39,654 

Gary D. Fedorochko Reg. No. 35,509 

Daniel E. Fisher Reg. No. 34,162 

William J. Fisher Reg. No. 32,133 

Patricia E. Hong Reg. No. 34,373 

Dale H. Hoscheit Reg. No. 19,090 

John P. Iwanicki Reg. No. 34,628 

Thomas H. Jackson Reg. No. 29,808 

Sarah A. Kagan Reg. No. 32,141 

Robert S. Katz Reg. No. 36,402 

Ernest V. Linek Reg. No. 29,822 

Peter D. McDermott Reg. No. 29,41 1, 

Christopher L. McKee Reg. No. 32,384 

Nina L. Medlock Reg. No. 29,673 



Timothy C. Meece Reg. No. 38,553 

Frederic M. Meeker Reg. No. 35,282 

Jon O. Nelson Reg. No. 24,566 

James A. Niegowski Reg. No. 28,331 

Thomas L. Peterson Reg. No. 30,969 

Joseph M. Potenza Reg. No. 28,175 

Thomas K. Pratt Reg. No. 37,210 

Christopher J. Renk Reg. No. 33,761 

Robert H. Resis Reg. No. 32,168 

John F. Rollins Reg. No. 38,013 

Steven P. Schad Reg. No. 32,550 

Michael H. Shanahan Reg. No. 24,438 

Charles W. Shifley Reg. No. 28,042 

Joseph M. Skerpon Reg. No. 29,864 

J. PieterVan Es Reg. No. 37,746 

Kathleen M. Williams Reg. No. 34,380 

Susan A. Wolffe Reg. No. 33,568 

Bradley C. Wright Reg. No. 38,061 

Katie E. Sako Reg. No. 32,628 

Daniel D. Crouse Reg. No. 32,022 

Darleen J. Stockley Reg. No. 34,257 



All correspondence and telephone communications should be addressed to: 

Banner & Witcoff 
1001 G Street, N.W., Suite 1100 
Washington, D.C. 20001-4597 
telephone number (202) 508-9100. 

We hereby declare that all statements made herein of our own knowledge are true and that all statements made on information 
knowledge and belief are believed to be true; and further that these were made with the knowledge that false statements made 
willfully are punishable by fine, imprisonment, or both a fine and imprisonment under Section 1001 of Title 18 of the United States; 
and further that false statements made willfully may jeopardize the validity of any patent issuing on an application in which the false 
statements were made. 
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